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Abstract 

In this paper we consider a system of spins that consists of two configurations 
a 1 , a 2 G Stv = {— 1, +1}^ with Gaussian Hamiltonians H]^{cr 1 ) and Hfj{a 2 ) corre- 
spondingly, and these configurations are coupled on the set where their overlap is fixed 
{i?l,2 = -A -1 YliLi a i a i = u n}- We prove the existence of the thermodynamic limit 
of the free energy of this system given that limjv^oo^v = u £ [—1,1] and give the 
analogue of the Aizemnan-Sims-Starr variational principle that describes this limit via 
random overlap structures. 
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1 Introduction and main results. 

In this paper we will consider a system that consists of two configurations of spins that are 
coupled by fixing their overlap. Our main goal is to prove the existence of the thermodynamic 
limit of the free energy of this system and to give the characterization of this limit via random 
overlap structures in the sense of Aizenman-Sims-Starr £Q. Let us start by introducing all 
necessary notations and definitions. 

For any N > 1, let us consider a space Eat = { — 1, +1}^ and consider two Hamiltonians 
H l N (cr) for £ = 1,2 on Ejv given by 

^(-HA^E^ E ^,.., v OU...«i v : (1-1) 

P>1 h,—,ip 
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where (gi u ...,i ) are standard Gaussian random variables independent for all p > 1 and all 
(ix, . . . , i p ), and the sequences (ap) p >i are such that 

EK) 2 <°°- (i.2) 

p>i 

For £, £' G 1, 2, let us define the functions : [—1, 1] — > R by 

P>1 



so that 



where the overlap 



i-E^^XM^e^^), (i.4) 



N 



R l , = R{<r\^) = W^l 



N 

i<N 

The condition (jl.2j) implies that the functions are well-defined and smooth on [—1,1]. 
From now on we will also assume that the sequences (a p ) are such that the functions 
are convex on [—1, 1]. For example, this holds if a e p = for p odd and a l p > for p even. We 
define the functions, 

Ot,e>{x) = x^ e ,(x) - &,e{x). (1.5) 
The convexity of implies that for any x, y G [—1, 1] we have 

&XaO-a#,/'(y) + My)>o. (1.6) 

Given u G [—1, 1], let us consider a sequence (un) w>i such that for each N we have mat = k/N 
for some integer — iV < k < N and such that lmi/v^ooWjv = u. Given the external fields 
hi,h 2 G R, we define, 

F N (u N ) = —ElogZ N (u N ), (1.7) 

where 

£*(«*)= E exp^^O+E^E^)- (L8) 

The quantity Fn(un) represents the free energy of the set of configurations {Ri,2 = un}- 
The main reason that was chosen of the type k/N is that this set be not empty. 
Our first goal will be to prove the following. 



Theorem 1 The limit 



lim F N {u N ) = V(u) (1.9) 



exists and depends on u but not on the sequence (lijv). 
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The main idea in the proof of this Theorem is the interpolation method of Guerra- 
Toninelli which was developed by authors in [3] to prove the existence of the thermodynamic 
limit of the free energy of one copy of the system with Hamiltonian H N (er). They also 
extended their method in |H] to prove the existence of the thermodynamic limit in a variety of 
mean field models. In fact, a part of the proof of Theorem^is very similar to the proof of the 
main result in [3] which was motivated by the idea of restricting to the set of configurations 
with given overlap introduced by Michel Talagrand in |5]. However, the situation considered 
in Theorem^is slightly different, mainly, due to the fact that we consider the set {Ri t 2 — u^} 
of configurations with overlap exactly equal to un rather than being in the neighborhood 
of un- This will require some additional approximation result, Lemma ^ below. We will 
prove that the sequence F n (un) can be approximated by a superadditive sequence over the 
restricted range of indices and apply the following Proposition due to DeBruijn-Erdos j2] 
(see also Theorem 1.9.1 in [§]). 

Proposition 1 (DeBruijn-Erdos) If the sequence (ajv) of real numbers satisfies the super- 
additivity condition 



Next, we will characterize the limit V(u) in (jl.9|) via the analogue of Aizenman- Sims- 
Starr variational principle 1. This characterization is motivated by the following idea. In 
fT3*j Michel Talagrand proved a certain replica symmetry breaking upper bound on Fn(un) 
and conjectured that the bound should be precise in the limit, i.e. should be equal to V(u) 
in (jl.9|) . He also emphasized that the computation of this limit is a natural approach to 
solving the so called chaos problem. It is interesting to note that the formula conjectured 
by Talagrand can be written via Derrida-Ruelle probability cascades as in the case of the 
Parisi formula in the Sherrington-Kirkpatrick model. On the other hand, the Parisi formula 
in the SK model written via Derrida-Ruelle cascades can be included in a broader variational 
principle described in ^ . This connection motivates us to give a variational characterization 
of the limit V(u) in terms of random overlap structures in the sense of Aizenman-Sims-Starr 
PP. We hope that this characterization will provide some insight into what should be the 
correct Parisi ansatz for V(u) and whether the formula conjectured by Talagrand indeed 
holds. 

Given a parameter 6 > 0, we define the random overlap structure (ROSt) as the following 
collection of: 

(1) a countable set A; 

(2) a sequence (q^fg) for 6 A,£,£' G {1,2} such that 



then lim, 



-rt 



oo 



a m+n >a m + a n over the restricted range -n < m < 2n, 
a n / n = sup a n /n. 



q%\ < 1, 9a,l = 1 an d - u\ < 6] 



(1.10) 



(3) an arbitrary random sequence (w a ) ae ^ such that 




(1.11) 
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(4) Gaussian sequences (z 1 (a), z 2 (a)) a& _A and (y 1 (a), y 2 ((x))aeA independent of each 
other and of the sequence (w a ) at =_A with the following covariance operators 

Ez e (a)/(P)=eeA& and = M(£$). (1.12) 

Let (^(a), Zj 2 (a)) Q e^ be a sequence of independent copies of (z l (a), z 2 (a)) Q6 ^ for i > 1. We 
also assume that all random variables here are independent of the Hamiltonians Hfj(er). Let 
us denote such generic collection (1) - (4) as 0$, where we will make the dependence of Q$ 
on the parameter 5 in (jl.lOj) explicit. 

One could try to describe conditions on the sequence (q^fg) that would guarantee the 
existence of the Gaussian sequences with the covariance structure (jl.l2j) . Instead, we will 
simply assume that we consider only random overlap structures Q$ that such sequences exist. 
One reason why we are not interested in the general case is because, as in pQ, one particular 
ROSt will play a special role in characterization of the limit V(u) in ()1.9|) and it will be 
constructed explicitly. Given a ROSt fls, let us now consider the quantity 

G N (u N ,n s ) = ^Elog^u; Q ex P E E a i( z i( a ) + h t) 

a£A Ri,2=u N i<2 i<N 

- iElog^^expViV^yV)- (1-13) 

a£A £<2 

The following theorem holds. 

Theorem 2 There exists a sequence (u' N ) such that liniAr^oo-u^y = u and such that the limit 
in FTfy 

V{u) = lim liminf G N (u' N ,fl s ). (1.14) 

TV— >oo S— >0 Clg 

2 Proof of Theorem H 

Given e > 0, let us consider a set 

U N ,s = { (c 1 , a 2 ) : R 1>2 G [u N - e, u N + e] } (2.1) 

and define 

f n (u n>£ ) = 1e log ex p (E + E ^ E °0 • ( 2 - 2 ) 

In order to utilize the ideas of Guerra and Toninelli in |lj and we first need to prove the 
following approximation result. 

Lemma 1 There exists a constant L independent of N such that for all e G [0, 1] 

F N {U N;E ) < F N (u N ) + L^e. (2.3) 
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Proof. For each cr 1 G Sjy let us consider the sets 

U e {a l ) = {cr 2 : R 1}2 G [u N - e, u N + e]}, [/(cr 1 ) = {cr 2 : i2 lj2 = w^}. 

For each cr 2 G [^(er 1 ) we can find an element ^(cr^cr 2 ) G ^(cr 1 ) such that the Hamming 
distance 

d(a 2 , a 2 )) = i £ /(a 2 ^ vr(cr\ cr 2 ),) < |. (2.4) 

t<A r 

Indeed, since i?i i2 = 1 — 2d(cr 1 , cr 2 ), for cr 2 G f/^cr 1 ) we have 

—2— ^^ } -^— +2' 

i<AT 



Therefore, by changing at most Ne/2 coordinates of the vector cr 2 we can obtain a vector 

1 ~ 2 ^ B11 'ui 

1 - Ujv 



n(a ■ ,ct ) such that 



which means that ^(cr 1 ,^ 2 ) G ^(cr 1 ) and c?(cr 2 , ^(cr 1 , cr 2 )) < e/2. If we write 



i<iV 



H 2 N (a 2 ) + h 2 J2^ = ^(vr(cr 1 ,cr 2 )) + / i2 ^7T(cr 1 ,cr 2 ) J 

i<iV i<V 

+ H 2 N (a 2 ) - H 2 N (n(a\ cr 2 )) + h 2 J> 2 - 7r(cr\ cr 2 ),) 
then, clearly, Fn(Un,e) < I + H, where 

I = ^Emax(^(cr 2 )-^(7T(cr\cr 2 )) + / i2 ^(a 2 -7r(cr\cr 2 )^ 



i<V 



< i-Emax(^(cr 2 ) - H 2 n {k{<j\ cr 2 ))) + |/i 2 | £ 

IS Un,s 



and 



II = II log £ exp (^(cr 1 ) + £ ^ + ^(^(cr 1 , cr 2 )) + ^ 2 ^ 7r(cr\ cr 2 ),) . 

To estimate the first term in I we use Slepian's inequality that implies (see |7j) 



Emax(^(cr 2 )-^( 7 r(cr 1 ,cr 2 ))) 



, / j\ 1/2 

< 3 v/log cardie max ( E (H 2 N (cr 2 ) - H 2 N (7i(a\ cr 2 ))) 

< 6iVv4oi2 max f 6,2(1) - 6,2 (#(<r 2 , 7r(cr\ cr 2 ))) 
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where we used (J1.4|) and an estimate car (1Un,e < 2 2Af . By f!2.4|) 

i?(o- 2 , v^cr 1 , a- 2 )) = 1 - 2d(cr 2 , TrfV, cr 2 )) > 1 - s. 

Therefore, 

6,2(1)- 6,2 (^^(trSo- 2 ))) < max \&^x)\e 

as6[-l,l] 

and, thus, I < L^fe. To estimate II we will simply count how many elements cr G U £ (cr l ) are 
projected onto an element cr 2 G [/(cr 1 ), i.e. for cr 2 G U(cr l ) we consider 



(cr\cr 2 ) 



card{cr G ^(er 1 ) : ^(cr 1 , cr) = cr 2 }. 



Then, obviously, 

II = ^Elog e(<7\° 2 )ew(H 1 N (* 1 ) + h 1 J2°t + HU<r 2 ) + h2j2 (T 

R ly2 =u N i<N i<N 

< F N (u N ) + max logger 1 , cr 2 ). 

IV -Rl,2=«JV 

Since by (|231), d(er 2 ,7r(cr\cr 2 )) < e/2, we have 

o- 2 ) < card{cr G Sjv : d(<r, cr 2 ) < e/2} = card{cr g Z N : /(a* ^ 1) < Ne/2} 

i<N 

= card{cr G £jv : ^ °i > N(l - e)} < 2 iV exp(-iV/(l - e)), 

where J(x) = |((1 + a;) log(l +x) + (l — x) log(l — x)). In the last inequality we used a large 
deviation estimate for the Bernoulli r.v. (see, for example, A. 9 in jH]). Hence, 

1 max logger 1 , cr 2 ) < log 2 - 7(1 - e) = logfl + -^—) + ~ log — < L^fe 
iv Ri,2=u N \ 2 — eJ 2 e 

for e G [0,1]. This finishes the proof of Lemma H 

□ 

Clearly, Lemma Q implies that 

IV2 



for \un — u' N \ < 1 and, therefore, in order to prove the existence of the limit liniTv^oo F N (u^) 
for any sequence (un) such that liniTv^oo = u it is enough to prove it for one such sequence. 
Therefore, from now on we will make a specific choice of (mat) that satisfies the following 
condition, 

1 . . 

\u N -u\<—. (2.5) 

Clearly, it is possible to take of the type = k/N that satisfies this condition. 
The next Lemma is similar to the techniques in [5]. 
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Lemma 2 If (un) satisfies \2. 5)) then there exists a constant A independent of N such that 
the sequence 

a N = NF N {u N ) - AN 1 ' 2 

satisfies superadditivity condition 

&m+n > clm + cbN over the restricted range -N < M < 2N. 

Proof. Given N, M > 1, let us consider a space T*m+n and for each cr e Ejv+m we will write 
cr = (p, r) where 

p = (pi, . . . , p M ) = {at,..., a M ) e S M , t = (n, . . . , tjv) = (cm+i, • • • , om+tv) G £tv- (2.6) 
For cr 1 = (p^r 1 ) and cr 2 = (p 2 ,r 2 ) we define 

^ 2 = J R(p 1 ,p 2 ) = ^^p i 1 p 2 and R1 2 = R(t\t 2 ) = ^J2 t ' t ' 

i<M i<N 

Let us write the overlap i?i i2 = -^(c 1 , cr 2 ) as 



_2 



" MTiV^> 2 + MTiV^' 2 ' 



Then we have, 

C/ Mi jv := {i2i, 2 = u M , R\, 2 = u n} C |i?i i2 = w' M+JV := n u m + m ^1 n u n}- ( 2 - 7 ) 



If we define £ = |i4f+jv — um+n\ then 

{-Rl,2 = u'm+n} — Um+N,s = |-Rl,2 £ [WM+jV _ £,UM+N + s] j 

and, therefore, £/m,./v C Um+n,e- This together with Lemma [T] implies, 

Fm+n{um+n) > F~m+n{Um+n,e) ~ Ly/e > F m+n (Um,n) ~ Ly/e, 

where 

Fm+n{Um,n) = Jf^ E lo § S ex P (2 #M+iv(0 + Z) ^ 2 a * 

I/m.JV £<2 £<2 i<Af+JV 

Condition ()2.5|) implies that £ < 3/(M + AT) and, therefore, 

F~M+n{um+n) > F m+n (U M ,n) - Jj^. — jyy/2 ■ ( 2 '^) 

Given t G [0, 1], let us consider an interpolating Hamiltonian 



NK T 



e<2 i<2 



where the Hamiltonians H^, and H e M+N are independent of each other, and define a 
function ip(t) by 

(M + N) V (t)=E\ogJ2^p(H t (<T 1 ,<T 2 ) + J2he ]T a fy ^ 

U M ,N i<2 i<M+N 

It is easy to see that 

M N 
<p(l) = F m+n (U m ,n) and <p(0) = tf + jy f M M + M + n Fn M- 

We will show below that for some constant L, 

<f'(t) > — . (2.10) 

Y W - N+M K J 

This control of the derivative will imply that ip(l) > y?(0) ~~ L/(M + N) and, combining this 
with (I2~£J) . we get 

(M + N)F m+n (u m+ n) > MF M (u M ) + NF N (u N ) - L(M + N) 1 ' 2 . 

If given A > we consider a sequence a at = NFn(un) — AN 1 / 2 then this can be written 
equivalently as, 

a M+ N > a M + a N + AM 1 ' 2 + AN 1 ' 2 - {A + L){M + iV) 1/2 . 
When N/2 < M < 2N, we have 

M l/2 + N l/2 > (M + ^1/2 ^ /l + /|^ 

and, thus, 

AM 1 ! 2 + AiV 1 / 2 _ (A + L)(M + iV) 1 / 2 > ((y^ + ^| - l) A - l) (M + iV) 1 / 2 > 0, 
if A is large enough. This proves that 

o>m+n > a M + O'N over the restricted range -N < M < 2N, 

which is precisely the statement of Lemma. I Hence, it remains to prove ()2.10|) . 

Let us denote by (-) t the average with respect to the Gibbs' measure Gm,n on Um,n 
with Hamiltonian 

H t (a\a 2 ) + J2he £ o{. 

£<2 %<M+N 

Then the standard computation utilizing Gaussian integration by parts gives (see, for exam- 
ple, [1] or Theorem 2.10.1 in [H]), 

(M + N)<p'(t) = i Yl E ( (M + N )^'( R w) ~ M &AKz>) ~ N&ARl e )) 
t,e<2 

-~ E((M + N)te, e (R{o*,d*)) - M^(R(p £ ,p e ')) - N^R^ ,t 1 '))) ^ 



where (cr 1 , cr 2 ) is an independent copy of (cr 1 , cr 2 ) with respect to the Gibbs' measure Gm,n- 
Since 

the convexity of implies that 

(M + iV)^(^(^, ^')) < M^{R{p\ jf)) + A^(#(t*, 7^)), 
and, therefore, 

(M + AV(t) >\J2 e (( m + N )MRw) ~ M &,A R h') - N&ARh>)) t ■ 

e,e'<2 

For £ = £' we have i?^ = i?^ = R\ t = 1. Also since the average (-) t is defined on Um,n we 
have i£[ 2 = um, R±2 = u n and by ()2.7|) i?i_2 = u' M+N . Thus, 

(M + iV)^(t) > (M + N)^ 2 (u' M+N ) - M^( Uif ) - iVe 1|2 (wiv)- 

Condition (J2.5)) implies that for all N we have iCi^C^jv) — £i,2(w)| < L/iV and this, clearly, 
implies (EHUD . 

□ 

Combining Lemma El and Proposition ^ proves that the limit \im^_ 00 a^/N exists and 
it is, obviously, equal to the limit hin^^oc Fn(un), which finishes the proof of Theorem[TJ 

3 Proof of Theorem [21 

In this section we will assume that the sequence (wjv) satisfies (J2.5j) . Let us start by proving 
the following upper bound. 

Lemma 3 For some constant L independent of N we have, 

F N (u N ) <MG N (u N ,Q s )+L5 + LN- 1 . (3.1) 

Proof. Consider an arbitrary random overlap structure Q$- Given t G [0, 1], let us consider 
a Hamiltonian H t (a, cr 1 , cr 2 ) on the set A x {i?i,2 = u^} given by 



H t {a,cr\cr 2 ) = y/i^T, H e N (<T £ ) + VN^y^ 



l 5 

l<2 i<N l<2 i<N 



and consider a function 

(p{t) = ^-Elog^w Q ^2 ex-VH t (a,cr l ,cr 2 ). 



N 

aeA Ri,2=un 
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Clearly, the statement of lemma is then equivalent to 

<p(l) < <p(0) +L5 + LN- 1 . 

We will prove this by showing that the derivative <p'(t) < L5 + LN~ Y . Let us denote by 
{■)t the average with respect to the Gibbs' measure on A x {Rip — ^tv} with Hamiltonian 
H t (a, cr 1 , cr 2 ). Then the standard computation utilizing Gaussian integration by parts and 
covariance structure ()1.12|) gives 



e,e'<2 



i,e<2 

where a -1 , cr 2 ) is an independent copy of (a, cr 1 , cr 2 ). Using the fact that the average (■)< 
is taken over the set where i?i j2 = un, the first sum on the right hand side is equal to 



where the last inequality follows from the fact that by (Jl.lUj) we have Ig 1,2 — u\ < 5 and by 
f)2.5jl we have \un — u\ < N^ 1 . The second line in (|3.2|) is negative by (jl.Oj) and this finishes 
the proof. 

□ 

To prove the lower bound, let us start with a couple of simple lemmas. 
Lemma 4 If a sequence (a N ) is such that limjv^oo a N /N = 7 then for any N > 1 we have 

— liminf(a M+iV - a M ) < 7- 

iV M^oo 

Proof. Suppose that for some N > 1 and for some e > 

-j- liminf(a M +A r - o>m) >! + £■ 

iv M—*oo 

Then there exists M > 1 such that for all M > M 

1 e 
— {a M +N ~ a M ) > 7 + g 

and, therefore, for fc > 

-^:( a Af+(fc+l)iV — a M+kN) > 1 + ~- 

Adding these inequalities for 0<fc<m-lwe get 

-jy(a M +mN - am) > m(^y + or — ^(aM+miv - > 7 + |- 

Letting m — > oo yields that liminf / N > 7 + e/2 and this contradicts the fact that 
limAr^oo a N /N = 7. 

□ 
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Lemma 5 Consider a sequence (un) such that \2. 5}) holds. Then there exists a sequence 
(u' N ) such that \u' N — u\ < 2/N and such that for each N > 1, 

mTn Um + mTn Un = UM+N (3 - 3) 

for infinitely many M > 1. 



Proof. For a fixed N, consider a sequence u' N (M) defined by ()3.3|) . i.e. 

Nu' N (M) = (M + N)u m +n ~ Mu M - 

We have 

N(u' N (M) -u) = (M + N)(u M+N - u) - M(u M - u) 

and, therefore, (|2.5|) implies that N\u' N (M) — u\ < 2. Since Nu' N (M) is an integer between 
—N and N, it can take a finite number of values and, thus, we can find an infinite subsequence 
(M fc )*>i such that u' N (M k ) = u^(Mi). Take = uJv(Mi). 

□ 



Theorem 3 There exists a sequence (u' N ) such that \u' N — u\ < L/N and for all N > 1, 

V(u) > liminf GnIu'kt, £lg). 
<5^0 U s 

Proof. If we consider a sequence = NFn(un) then, by Theorem ^ we have that the 
limit linijv_+ 00 a^/N = V(u). Lemma^then implies that for any N > 1, 

- liminf ({M + N)F M+N (u M+N ) - MF M {u M )) < V{u). (3.4) 

We can write 

— N)F m+n (u m +n) - MFm^m)^ = ^Elog Z M+N (u M+N ) - ^Elog Z M (u M ), (3.5) 

where Zn(un) was defined in (jl.8j) . For er G Xaz+tv we will write cr = (p, r) as in (|2.6jl . 
Consider the sequence (w^) as in Lemma El Then as in (|2.7|l the condition ()3.3|) implies that 
for infinitely many M > 1 we have 

{-Rl,2 = Um+n} ^ ^M,N := {-^1,2 = M M, -Ri,2 = M 7v}- 

For simplicity of notations let us assume that this holds for all M > 1 rather than a subse- 
quence (Mfc). Therefore, 

^m+n^m+n) > Z MtN (u M ,u N ) : = exp H e M+N {cr e ) +J2 h * a • 

LT' w ^<2 ^<2 i<M+N 
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Let us decompose the Hamiltonian in Zm,n{um-,un) as, 

5>W-0 + 5> E < = E^v(p0 + 5>£pf 0.6) 

^<2 t<2 i<M 

+ EEW)+m+% 1 , 



£<2 £<2 i<M+N l<2 i<2 i<M 



CT 2 ). 



£<2 i<N 



The first two terms on the right hand side represent the part of the Hamiltonian that depends 
on the first M coordinates p only, i.e. here 

H l M+N {P l ) = (M + A0 1/2 E (M + N>/2 E 9n,-*A---Pl ( 3 - 7 ) 

p>l ^ ' h,...,i p <M 

The third term consists of the terms in the Hamiltonian that depend only on one of the last 
N coordinates (rf , . . . , rjy) of a e , i.e. 

p>l ^ ' ii,...,i p _i<M 

where 

(i) , I, 

9ii,...,i p -i ~ 9i,ii,...,i p -i i 9ii,i,...,i p -i ~r • • • i 9h ) ...,i p ^i > i- 

Finally, the last term ^(cr 1 , er 2 ) consists of all the terms of the Hamiltonian that depend on 
at least two coordinates in r . Note that Ricr 1 , cr 2 ) is independent of all other terms in (jH.fij) 
and, therefore, Holder's inequality implies that 



^E log Z m ,n{u m , u n ) > — E log ^ exp (^ #l /+JV (p £ ) + E ^ E ^ 

+EE^V) + m). (3i 



^<2 i<JV 

.1 



For each (p , p ) let us denote 

H/(p\ p 2 ) = exp (J2 Hi I+N (P e ) + E h ' E rf) 

£<2 £<2 i<M 

so that ()3.8|) becomes 

^ElogZ M , N (u M ,u N ) > i-Elog ]T H/(p 1 ,p 2 )exp^^r/(^(p £ ) + M- (3-9) 



u' M N £<2 i<N 



The sequences (Zf(p e )) are independent for different indices i, and the covariance operator 
of [Z[ (p £ )) is given by 

EZt(p*)Zf(pt') = E(m^v) P_1 4<K^p' ) Z))^ 1 = /)) + om(1) 

P>1 
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as M — > oo, uniformly over R(p e ,p e ') G [-1, 1]. Therefore, one can substitute (up to a small 
error) the random variables Z^(p e ) in (|3.9|) with the random variables 

p>l ii,...,i p _i<M 

with covariance operator 

E^tftftf) = (3.11) 

Namely, we have, 



IT' £<2 i<N 



i-Elog £ WV,P>*pEE t Mp') + M + M1), 



AT 

!7' w ^<2 i<JV 



£/ I j\ \ ^ I ( ^ It \ ^ \ (j) ^ ^ 

J i IP ; t ) = a p \ j^( P -i)/2 + (M + N) (p- 1 )/ 2 / ^ 9i- L ,...,i p _ l Pi l ---Pi p _ 1 

p>l V ; ii,...,i _i<M 



when M — > oo. This is easy to show by interpolating between Z[ and z\ via 

i 1-t 

_ Fiya + (M + A^)(p 

P>1 ii,...,i p -i'_ 

and considering 

<p(f) = ^Elog £ W(p\p 2 )e W J2J2 T '( z "(P e ^ + h ^ 



U' i<2 t <N 



Then it is a straightforward calculation to show that ip'(t) = 0m(1) uniformly for t G [0, 1]. 
Thus, we finally get, 

log Z M>N (u M , u N ) > ^E log W (P^ P 2 ) ex P E E T "(4(P £ ) + h e ) - o M (l) 

' U 'm,n ^ 2 ^ N 

= ^ E1 °S E W (P^P 2 ) E expJ]^r/(4(^) + M-OM(l) (3.12) 

R\, 2 =um RI,2= u 'n £<2i<N 

where zj(p £ ) are defined in ()3.10j) . Next, let us consider 



z M (u M )= ex p(E^^)+E^E 

R\ 2 =u M ^<2 ^<2 i<M 



pU- 



Comparing 



p>l ii,...,i p <M 
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with H i M+N {p l ) in ()3.7|) we can write 

KAd) = H e M+N (p £ ) + v^V) (3-13) 

where 

yi, a _ 1 S^f - - V^ 2 £ £ f 

T^^VM^ 1 (M + JV>-V V ^ 9ii,...,i P Pn ■ ■ ■ P ip , 



where (g^,...,^) are i.i.d. Gaussian r.v independent of the Hamiltonians H^ +N (p e ). Using 
(jSHSJ), we can write 

±MlogZ M (u M ) = ^Elog Yl exp(^^ +JV (/)+E^E^ + ^E y V)) 

= ^ E1 °s E wV^Wv/iv^TrV)- (3-14) 

It is easy to compute that the covariance operator of (Y e (p e )) satisfies 

ErV)^V) = 6i,AR(p e ,p e ')) + OM(i) 

as M — > oo. Therefore, as above one can substitute (up to a small error) the random variables 
(y £ (p £ )) in (j3.14j) with the random variables 

Z/V) = E^- 1 K E ~9n,..,iA---P^ (3-15) 

p>l ii,...,i p <M 

with covariance operator 

V(/VV) = Mfl(/*V))- (3-16) 

(|3.14j) then gives, 

^ElogZ M ( MM ) = lElog ^ WV,P>XP^^>V)+M1) (3-17) 
as M — > oo. Plugging (gH) and (EH7f) into and (Q we get 



where 



7>(u) >liminfG MJV (3.18) 

M-+oo 



Gm,n = ^Elog £ W(p\p 2 ) Yl exp^5>/(^V)+M 

-^Elog £ W(p\p 2 )exP^E^V)- (3-19) 
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If we define a = (p 1 , p 2 ), define 

A = {(p\ p 2 ) : R\ i2 = R( P \ p 2 ) = u M }, (3.20) 

let 

w a = W{p\p 2 )/ ( 3 - 21 ) 
and let zf(a) = zf(pr) and y l (a) = y e (p £ ), then ()3.19|) can be rewritten as 
G m ,n = ^Elog^w Q ex Pj2J2 T i( z i^ + 

a£A R 2 ia =u' N t<2 i<N 

~ log £u; a exp (3.22) 

a<=A l<2 

Clearly, Gm,n is written in the form of ()1.13|) . i.e. Gm,n = Gn(u' n , where the random 
overlap structure Q s is the collection of (I3~2T1J) . (I3~2T| . (I3~in|) and (I3~T^|) . Equations (ETTTl) 
and ()3.16|) imply that the conditions (1) - (4) in the definition of ROSt are satisfied with 
&J3 = R (p e iP £> ) where (3 = (p 1 ,^ 2 ). Since ql' 2 a = R(p l , p 2 ) = u M f or a = (p x ,p 2 ) G A, we 
can take 5 = \um — u\ which goes to as M — > oo. Equation (j3.18|) . therefore, implies 

V(u) > lim inf Gn(u' n , 

8 — s-O 

This finishes the proof of Theorem |3J 

□ 

Lemma El and Theorem El of course, imply Theorem El 

In conclusion, we would like to note that the analogue of the Aizenman-Sims-Starr 
variational principle is particularly interesting because of the specific representations of the 
random overlap structures (|3.19|) or (|3.22|) . We hope that the analysis of these structures 
will direct toward what should be the Parisi ansatz for the limit V[u) in (|1.9J) or, at least, 
will provide some ideas in this direction. 
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